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What is claimed is: 



Q 



1 . \ A hyperlinked broadcast system comprising: 
video source; 

awideo encoder in communication with said video source, said video 
encoder producing a transport stream; 

anl^nnotation source; 

a dkta packet stream generator in communication v^th said annotation 
source and said video encoder, said data packet stream generator producing encoded data 
packets; and 

a m iltiplexer system in communication v^th said video encoder and said 
data packet stream generator, said multiplexer generating a digital broadcast signal 
comprising an augmented transport stream from said transport stream and said encoded 
data packets, 

wherein sai 1 video encoder provides timing information to said data packet 
stream generator ar d said data packet stream generator synchronizes annotation data 
from said annotatio i source v^th a video signal from said video source in response to 
said timing information. 



m 



2. The ^stem of claim 1 wherein said timing information comprises one of 
timestamp information, timecode information, frame nxmibering information and global 
time of day. 



The system of claimll Wh^ein said armotation data comprises mask data 



and at least one of textual data and graphics data. 

4. The systeni of claim 3 wherein said mask data includes location 
information of an object in anarmotated video frame. 
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5 A The system of claim 4 wherein said location information includes a 
graphics location reference that represents a fixed relation to a set of pixels associated 
with said omect. 



6. \The system of claim 5 wherein said graphics location reference includes 
an upper left most pixel in said associated pixel set. 



7. 

centroid pixel o 



le system of claim 5 wherein said graphics location reference includes a 
said associated pixel set. 



8. The system of claim 3 wherein said mask data comprises location and 
shape informatidn of an object in a video fame to be armotated. 



graphical overlay 



Ttie system of claim 8 wherein said shape information is represented by a 
of said object. 



The 



10. 

outline of said ob 



system of claim 8 wherein said shape information is represented by an 
ect. 



1 1 . Th? system of claim 8 wherein said shape information is represented by a 
mathematical reprfesentation of a set of pixels associated with said object. 



12. A hyperlinked broadcast and reception system comprising: 
a video source; 

a video encoder inx5ohimunication with said video source, said video 
encoder producing a transport strea^;i^^^ 
an annotation source; 

a datapacket stream generator in communication with said aimotation 
source and said video €;pcoder, said data packet stream generator producing encoded data 
packets; 
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a itmltiplexer system in communication with said video encoder and said 
data packet stream gtenerator, said multiplexer generating a digital broadcast signal 
comprising an augmented transport stream from said transport stream and said encoded 
data packets; 

a broadcast channel in communication with said multiplexer system; 
a receiver! in communication with said broadcast channel; and 
a display ^evice in communication with said receiver, 
wherein said videi* encoder provides timing information to said data packet 
stream generator and said data packet stream generator synchronizes armotation data 
from said annotation sour ce with a video signal from said video source in response to 
said timing information, and 

wherein said display device displays said amiotation data associated v^th said 
video signal in response t) a viewer request on a frame by frame basis. 



13. Thesysterji 
timestamp information, 
time of day. 



of claim 12 wherein said timing information comprises one of 
tihiecode information, frame numbering information and global 



14. The system of claim 12, wherein said annotation data comprises mask data 
and at least one of textual data and graphics data. 

15. The systern of claim 14, wherein said mask data and said at least one of 



textual data and graphics 
channel. 



data are transmitted over separate streams in said broadcast 



16. The system of claim 14 whe(;ein^aid mask data comprises location 
information of an object n an annotated video frame. 

17. The system of claim 16 wherein said mask data further comprises shape 
information of an object in an annotated video fi^me. 
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1 8. Yhe system of claim 12 wherein said timing information is employed to 
synchronize the oisplay of annotation data from said annotation source with said video 
signal from said viaeo source. 

19. The system of claim 18 wherein said timing information comprises one of 
timestamp informatiqn, timecode information, frame numbering information and global 
time of day. 

20. The system of claim 12 wherein said system transmits information related 
to said viewer request tp a remote location over a backchannel communications channel. 

21 . The system of claim 20 wherein said backcharmel communications 
channel is a store-and-fcWard channel. 

22. The systern of claim 12, wherein said annotation data comprises 
information regarding goads and services for sale. 

23. The system \ of claim 12, wherein said annotation data comprises non- 
commercial information. 



24. A hyperlinkea reception system comprising: 

a receiver in communication with a broadcast channel; and 
a display device in communication with said receiver, 

wherein said receiver decodes \i digital broadcast signal to recover a video signal and 

annotation data; and 

wherein, in response to a viewen request, said'^ display device displays said aimotation data 
associated with said video signalvon a frame ijy^canie basis. 



25. The system of clain^24 wherein timing information is employed to 
synchronize a display of said annotation data with smd video signal. 
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26. Th^ system of claim 25 wherein said timing information comprises one of 
timestamp information, timecode information, frame numbering information and global 
time of day. 

27. The sysiem of claim 25 wherein said receiver synchronizes said annotation 
data with said video sigbal in response to said timing information. 



28. The systdbi of claim 24 wherein said annotation data comprises a plurality 
of annotations having equal timing information, and said viewer request comprises an 
indication as to which aiiiotation of said plurality of armotations is to be displayed. 



29. A hyperliriked reception system comprising: 
a receiver m communication with a broadcast channel; and 
a display device in communication with said receiver, 

wherein said display device displays armotation data associated with a video signal, in 
response to a viewer request, on a frame by frame basis, said armotation data being 
associated with said video signal in response to timing information. 

30. The system of claim 29 wherein said timing information comprises one of 
timestamp information, time9ode information, frame numbering information and global 
time of day. 



31. A method of generating a hyperlinked video signal, comprising: 
providing a source video; 

encoding said source video with a video encoder to produce a transport 
stream and timing informationi 

providing a sourbe of annotat 

communicating said transporLstfeam and timing information from said 
video encoder and said annotationydata from said source of annotation data to a data 
packet stream generator, said data p^eket stream generator synchronizing said annotation 
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video signal from said video source in response to said timing information 
and producing encoded data packets. 



32. \The method of claim 3 1 wherein said timing information comprises one of 
timestamp info^ation, timecode information, frame numbering information and global 
time of day. 



33. The method of claim 31, wherein said annotation data comprises 
information regarding goods and services for sale. 

34. Thelmethod of claim 3 1 , wherein said annotation data comprises non- 
commercial information. 

35. The method of claim 3 1 wherein said annotation data comprises mask data 
and at least one of textual data and graphics data. 

36. The method of claim 35 wherein said mask data includes location 
information of an object in an annotated video frame. 

37. The metnod of claim 36 wherein said location information includes a 
graphics location referei|}ce that represents a fixed relation to a set of pixels associated 
v^th said object. 

38. The method of claim 37 wherein said graphics location reference includes 
an upper left most pixel iri said associated pixel set. 



39. The method of claim 38 whe^eilTsaid graphics location reference includes 
a centroid pixel of said assoqated pixel set 




40. The method of claim 35 wherein said mask data comprises location and 
shape information of an object it^W^annotated video frame. 
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41 . Vrhe method of claim 40 wherein said shape information is represented by 
a graphical ovemy of said object. 

42. The method of claim 40 wherein said shape information is represented by 
an outline of said obWt. 

43. The method of claim 40 wherein said shape information is represented by 
a mathematical representation of a set of pixels associated with said object. 

44. The method of claim 3 1 , further comprising: 
communicating said transport stream and said encoded data packets to a 

multiplexer system, said multiplexer system generating a hyperlinked digital broadcast 
signal comprising an augmented transport stream from said transport stream and said 
encoded data packets. \ 

45. The method! of claim 44 wherein said annotation data comprises mask data 
and at least one of textual data and graphics data and wherein said mask data and said at 
least one of textual data andlgraphics data represent separate streams contained in said 
hyperlinked digital broadcast signal. 

46. The method ofWlaim 44, further comprising: 
broadcasting said hyperlinked digital broadcast signal. 

47. A method of viewing a hyperlinked video signal, comprising: 
receiving a hyperlinked video signal comprising an augmented transport stream; 
demultiplexing said augmented transport stream to recover a transport stream and 

encoded data packets; \ 
displaying said transport stream framewise as a video on a display; 
decoding said data packets to recover annotation data and timing information; 
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synchronizing said annotation data with said video using said timing information; 
and 

in response \p a viewer request, displaying said annotation data on said display on 
a frame by trame basis. 



48. The method of claim 47 wherein said timing information comprises one of 
timestamp informatioi^, timecode information, frame numbering information and global 
time of day. 



49. The method 
transmitting in 
backchannel communidations 



of claim 47, further comprising 
^rmation related to said viewer request to a remote location over a 
charmeL 



50. The method of claim 47, further comprising: 



in response to a 
commercial tr; 



viewer prompt, accepting from a viewer information regarding a 
saction, and completing said transaction. 



5 1 . The method of claim 50, wherein the information regarding a commercial 
transaction accepted ft-oni a viewer/colnprises at least one of a viewer's identifier, a 
viewer's address, an identifier of a vjel^er^Tinancial account, a viewer's password, a 
viewer's personal identification number, a quantity, a model, a size, a color, a descriptor 
of a good or service to be vended, and a price. 
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